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THE SOFTWARE FOR THE EXPERIMENTAL TELEVISION CENTER COMPUTER | 
ASED VIDEO. SYNTHESIZER IS DESIGNED TO SATISFY THE FOLLOWING CRITERIA. 
IMSTLY, THE SOFTWARE IS CONCERNED. WITH GRAPHIC DESIGN AND COMPOSITION 
ECDNDLY» THE SOFTWARE WILL BE ABLE TO ANALYZE AND SYNTHESIZE IMAGES» — 
NA FINALLY, THE SOFTWARE PROGRAM WILL REPROGRAM ITSELF IN RESPONSE — 
O TEXTERNAL STIMULAE. IN ORDER TO MEET THESE CRITERIA THE PROGRAM MUST 
E RREAL-TIME AND INTERACTIVE. THE ARTIST WILL CREATE IMAGES AND — 
EGUENCES OF IMAGES IN DIALOGUE WITH THE PROGRAM. 
IN WRITING THE SOFTWARE I HAVE WORKED FROM THESE DEFINITIONS. 
HW VIDEO SYNTHESIZER IS A GROUP OF PROGRAMMABLE MODULES FOR CREATING © 
MAGES» THE COMPUTER PROGRAMS THE MODULES COMPRISING THE SYNTHESIZER. — 
HE IMAGE CONTAINS BOTH TEMPORAL AND SPATIAL INFORMATION WHICH CONCERNS 
HH ARTIST AND THE PROGRAMMER. THE IMAGE IS.RESURRECTED EVERY FIELD i ae 
K/60 SEC ) AND THIS BECOMES THE TIME-BASE FOR THE PROGRAM. NEW CONTROL 
AHAMETERS ARE TRANSFERRED TO THE SYNTHESIZER MODULES EVERY FIELDe | a 
4 COMMON MISTAKE IN DEVELOPING NEW PROGRAMS IS TO BORROW FROM — 
NA TO IMITATE RELATED MEDIA SUCH AS ELECTRONIC MUSIC. I AM INCLUDING 
NITHE PROGRAM COMMANDS TO EFFECT THE ELEMENTS AND ATTRIBUTES OF GRAPHIC 
ESIGN SUCH AS? ‘ 
le CREATING POINTS »LINES AND BASIC SHAPES 
@-¢ CREATING TEXTURES 
3-¢ DEFINING AREAS AND BOUNDARIES 
Ae DEFINING OBJECT/FIELD RELATIONSHIPS 
Se CONTROLLING VALUE» LUMINENCE AND CONTRAST 
6+« CONTROLLING CHROMA, SATURATION AND HUE ; ; 
7+ CREATING SEQUENCES OF IMAGES, TIMING PATTERNS ee eae 
8- CONTROLLING DENSITY ' 
9. CONTROLLING BALANCE AND SYMMETRY 
10+ CONTROLLING DEPTH». SCALE AND PROPORTION ~ 
11+ CREATING FOCAL POINTS 
22+ CREATING HARMONY, RHYTHM AND COUNTERPOINT 
13. CREATING MOTION: TRANSLATION, ROTATION, WARPSs ETC. eo 


THIS PECULIAR APPROACH TO DESIGNING SOFTWARE IS NECESSARY IN 
. RMER TO DEVELOP A PROGRAM USEFUL TO THE ARTIST$ A PROGRAM THAT SPEAKS 
HY ARTIST*S LANGUAGE» THE TASK IS NOT AS HOPELESS AS IT APPEARS; THE 
OST WARE DESCRIBED SO FAR RUNS ON HIGH SCHOOL MATHEMATICS. IT DEPENDS | 
N OTHE DEVELOPMENT OF SPECIALIZED HARDWARE TO CONTROL VARIOUS ASPECTS 
F WHE’ IMAGING PROCESS AND TO ANALYZE REAL BND PRERECORDED IMAGES. 


: -USING SPECIAL PROGRAMS AND PROGRAMMING TECHNIQUES» THE COMPUTER 
Il, BE ENDOWED WITH A MINIMAL I.Q- ON THE ARTIFICIAL INTELLIGENCE 
CSLE. THE COMPUTER WILL NOT RESPOND IN A TOTALLY; PREDICTABLE WAY. THE ' 
EGREE OF UNPREDICTABILITY IS DETERMINED BY THE ARTIST~ 
SED WITH THIS REPORT IS A FIRST ATTEMPT AT A PROGRAM OF 
Hrs TPE. THE IMAGING PROCESS IS CONTROLLED EITHER NUMERICALLY AS IN 
OM MCARTHUR'S XY GENERATOR» OR WITH DIGITAL TO ANALOG CONVERTERS. 
MAGES ARE ANALYZED USING THE ANALOG TO DIGITAL CONVERTERS. FINALLY, 
py ke THE’ COMPUTER CONVERSE USING’ THE TELETYPE AND THE REAL- 
CE. 
‘THE PROGRAM POLLS A’ SET OF DATA BUFFERS ( RESERVED AREAS OF. 
OMPUTER MEMORY ) EVERY FIELD. EACH DATA BUFFER CONTROLS A PARTICULAR 
ABDWARE MODULE. THE DATA IN THE BUFFERS. IS TIME DEPENDENT ALLOWING 
OR THE CREATION OF COMPLEX TIMING PATTERNS USING THE FIELD AS THE 
ASIC TIME UNIT. 
AT PRESENT ONLY THE SIMPLEST CONTROL PARAMETERS ARE PROGRAMMED. 
AM ‘MODIFYING THE PROGRAM TO ACCEPT TELETYPE INPUT IN REAL-TIME. 
_HYS WILL ALLOW THE ARTIST TO TALK TO THE PROGRAM AND TO SYNTHESIZE AND 
ODMIFY IMAGES AS THEY ARE BEING GENERATED. . 
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DHE: FIRST STEP IN THE PROGRAM iS-Ta® INITIALIZE THE MODULES ONE S 
“pone SETTING ‘EACH’ TO ITS NORMAL DEFAULT CONDITION. HOWEVER. ‘THERE' Ss Pee. 
—TMLE HOUSEKEEPING TO BE DONEe THE TABLES AND DATA BUFFERS ARE DECLARED 
S$ GLOBAL VARIABLES WHICH ALLOWS THEM TO BE ASSEMBLED SEPERATELY FROM 
‘HE MAIN. PROGRAM. THIS ae ‘DONE WITH THE FOLLOWING STATEMENT: 


.GLOBL TABLES» EBUF,DBUF 


MORE. ABOUT THESE TABLES “AND DATA BUFFERS IN CHAPTER 3+ NEXT THe 
SSEM MACROS ARE INVOKED WITH THE sg mat otetie STATEMENTS + ee 


Agee Ha BEGIN: +MCALL +0066 REGDE, EXIT. 
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oe THE LABEL. BEGIN IS USED BY ‘THE LINKING LOADER TO IDENTIFY THE: 
_ NTRY POINT TO THE MAIN PROGRAM. THIS TS DONE USING ‘THIS Ae ets AT 
TEND OF THE PROGRAM: © ; 


es .eV2e. MACRO IDENTIFIES THE MONITOR SYSTEM USED BY THE ‘Estes: 
le WHE +«REGDEF MACRO DEFINES THE LSI-11'S INTERNAL REGISTERS EAS 
wD CHARACTER pass hal AS dere eae 
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Now WE'RE. READY TO INITIALIZE THE D/A'S WHICH IS ACCOMPLISHED 
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THE FIRST LINE OF. CODE MOVES THE OCTAL NUMBER 100000 TO THE 
UOPUT WORD IN MEMORY WHICH CONTROLS THE D/A'S. THIS CAUSES THE D/A 


_ OTOUTPUT A CONSTANT ZERO VOLTS ¢ +10V= 177700 AND -10V= 0 )- THE 


FIX # DEFINES A REAL. NUMBER» AND THE PREFIX @# DEFINES. A LOCATION 
NMEMORY-e HOWEVER THE DATA TRANSFER IS NOT CONSUMMATED UNTIL THE D/A 


HANNEL IS ADDRESSED THROUGH THE CHANNEL ADDRESS WORD. THERE ARE & D/A, 


HOINELS NUMBERED O0-7+ THEREFORE WE SET REGISTER 0 EQUAL TO 8».OR OCTAL 
O1CLINE 2)+ THEN WE COUNT DOWN REGISTER 0 WITH A LOOP (¢ LINES 3,5 AND 

& AND AT THE SAME TIME ENABLE THE D/A'S BY MOVING THE CONTENTS OF 
BGISTER 0 TO THE CHANNEL ADDRESS WORD (¢ LINE 4 ). 
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INITIALIZE THE. ‘BUFFER MEMORY AS FOLLOWS# 
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THE: FIRST ‘WoRD- 1s CLEARED ¢ LINE 7 
On SINGLE FIELD ¢ LINE. B de NEXT ADDRESS 
ATED AND PUT IN- THE THIRD WORD € LINES 9- 


UF FERS EACH CONTAINING 128 WORDS. ay oe THE ‘POINTER Is ‘SET TAIT 
COR ONSE ae ae : 


" POINTER= “#DBUF + (256% ¢ TURK. 1) 


; THIS. FORMULA 1g ‘CODED FROM RIGHT ‘TO LEFT. IN LINE 9. TMRX Ts S 
OWED: INTO REGISTER. 13 THE DECREMENT INSTR TION IN LINE. 10 SUBTRACTS 
FROM THE REGISTER ‘THE SWAP BYTE INSTRUCTION IN. ‘LINE’ 11 EFFECTIVELY 
ULTIPLIES THE. REGISTER BY 256 (€ EQUIVALENT TO 8. ‘LEFT SHIFTS 3 DBUF IS 
DED. ‘TO. REGISTER 1. IN. LINE 12 AND. FINALLY IN LINE 13 THE RESULT IS 


BORED IN ‘THE PARAMETER BUFFER ghey THE ee Seer cata 
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Be TIMING “ROUTINE. 3 
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eR ee FROM HERE. WE Go TO THE: TIMING ROUTINE. ¢ TMR )- THIS ‘ROUTINE EN-_ 
‘aes THE 1760. SEC: INTERRUPT 5 AND. EVERY 1/60 SEC POLLS THE PARAMETER AEN 
UFFER CHECKING FOR TIME OUTS ¢— “TIMING COUNTER EQUAL TIMING INTERVAL Ties 

LSS Bi PATA BUFFER TIMES OUT A BRANCH TO. THE’ NEXT BLOCK OF CODE 1S. 


BLES InseRRUPTS THUS. THE COMPUTER INTERRUPTS ITS NORMAL FLOW OF 7 
_- P@RATIONS AND AS A PRECAUTION PUSHES THE CURRENT PROGRAM COUNTER ¢ PC 
| ROREGISTER 6 ) AND THE PROGRAM STATUS WORD ( PSW ) ONTO THE STACK. THE. 
- ‘AGK POINTER ( SP ) IS DECREMENTED BY 4- THEN THE COMPUTER GOES TO A — 
_ |REDETERMINED LOCATION IN MEMORY ( IN THIS CASE LOCATION 170 ) AND USES 
_ HE CONTENTS AS THE NEW PROGRAM COUNTER © PC )»* EXECUTION BEGINS ANEW .— 
WE THE LOCATION POINTED TO BY @#170- USUALLY THIS IS AN INTERRUPT =~ 
ERVICE ROUTINE» “HOWEVER I See Sieh A SHORTCUT ‘AS EXPLAINED ohne ) 


Tune MOV #TMR1,0#170° 
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ee, ep “ASSUMING “ALL: “THE ‘BUFFERS WERE ‘CHECKED WE BRANCH BACK TO ae 
& ‘ANT FOR a NEXT INTERRUPT aoe LINE A de OTHERWISE. WE INCREMENT. REGISTER 
NE 6 ‘My _AND CHECK ene ENABLE BUFFER Ae pene 7 iat ae de IF Laie ne 


BACK TO. TMR2 ¢ LINE At oe IF THE. ‘BUFFER 1s. ENABLED THE ‘TIMING 
NCREMENTED c LINE 12 ) AND COMPARED WITH THE TMING INTERVAL. 
ae THE COUNTER Is LESS. THAN ORs EQUAL TO THE INTERVAL WE 
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(RO) Is ‘MOVED TO REGISTER 1. THEN. THE. ‘COMMAND WORD CR1)+ IS MOVED 


_ ISTH DIGIT INDICATES THAT THE INDEX VALUE FOLLOWS THE INSTRUCTION. 
HE INDEX ‘VALUE PLUS THE PROGRAM COUNTER EQUALS THE DESTINATION ADDRESS« 


ee RE “INDEX VALUE IS MOVED TO LOCATION. INT=2 ye LINE T2 REGISTER 5 ISA 
So CBRE FLAG SET FOLLOWING THE OUTPUT COMMAND, IT IS CLEARED INITIALLY 
_ WINE 8 D6 THE JUMP SUBROUTINE INSTRUCTION IS EXECUTED ¢ LINE p feet ees 8 


ADA BUFFER. POINTER € LINE 10 )- THE DONE FLAG € R5°) IS TESTED ¢ LINE 


TEE TE ZERO’ THE PROGRAM BRANCHES BACK AND READS THE NEXT COMMAND WORD 
coe ie. pe (OR RETURNS | TO THE. ce siha a ROUTINE: ¢ LINE 13 )e 
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ROM THE ‘DATA BUFFER TO REGISTER 23 AND THE DATA POINTER IN- ‘AUTO- ~INCRE- — 
IPED ¢ LINE 2). THE JUMP SUBROUTINE THROUGH THE PROGRAM COUNTER INS 
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EBHE - LINKAGE POINTER- THE FIFTH AND SIXTH DIGIT REPRESENT THE DESTI- 

ANION, THE FIFTH DIGIT SPECIFIES THE INDEX ADDRESSING. MODE anb THE. 
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é ak Loop. COMMAND | (40) IS” ‘ENCOUNTERED IN. THE DATA BUFFER. 
ROUT NE FIRST COMPARES THE. COUNTER WITH THE MAXIMUM NUMBER. 
on ae THE MAXIMUM NUMBER - 

HIRD WORD IN THE PARA- 


3 bop tf 
UPDATED WITH THE POINTER TO THE me TOP OF THE LOOP, AND 
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NTERPRETER (LINES 3 “THE COUNTER IS EQUAL TO. 
: ; 1 CLINE 2)> CLEAR THE) 
CLINE 7)» AND RETURN TO 
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“ACL RL 


THEREFORE THEY. “ARE CROSS- 
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“BROOD 
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ca oe oe ee aes ee oo 


gees TO. REGISTER 1» AND THE. BUFFER POINTER INCREMENTED. IF THE DEVICE | 
_ UNBER ES GREATER THAN 8 BRANCH TO IN1 ¢ LINES. 2. AND 3 -}. IF NOT MOVE: — 


ATA Le (LINES 4 TO ‘13 ) AS FOLLOWS: 


“HINALLY REGISTER 2 TRANSFORMS ITSELF INTO THE REQUESTED DATA 
2 awe 14a 


y THITAL CONVERTERS ( INPUT DEVICES 9- 12 + 


) “INL _ OMP R2>#15_ 
2 ieee BBL. INQ / 
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S) MOV et | ig ss 
C) ‘RTS Wee. ee co chess SNS 


-HETCONTROL | WORD » \LEWCHA ( LINES 3 AND 4 )-. THE DATA APPEARS AT THE INPUT 
; RD LEWIN: AND. 1S TRANSFERRED TO REGISTER 2 € LINE 5 de WE RETURN TO THE 
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“In LINE 1. ‘THE INPUT DEVICE NUMBER Is TRANSFERRED FROM ‘THE DATA 
HE TABLE ENTRY NUMBER TO REGISTER 2 AND CALCULATE THE ‘LOCATION ° OF THE 
“Locations #TABLES+2* (ENTRY NUMBER-1)+16*( DEVICE NUMBER- es 


}AND WE RETURN TO THE CALLING SUBROUTINE ¢ LINE, AS De 


ye 
THE. SECOND bane OF THE INPUT ROUTINE SERVICES ‘THE ANALOG 10 


AGAIN. WE “TEST. THE. DEVICE ‘NUMBER. > LF: GREATER THAN 12 BRANCH TO 
NB ( LINES 1 AND 2 )« THE CHANNEL ADDRESS IS CALCULATED AND MOVED TO 


i, 


MODEL 0 OF THE ‘EFFICIENCY. OF MEMORY MAPPED 1/0» 
gST THE DEVICE NUMBER. IF GREATER THAN 13 BRANCH TO IN3 ¢ “LINES” i: AND 
ys INGLE LINE OF ne ee ‘DATA 1S TRANSFERRED ‘TO REGISTER 2 
ND SUBRC 


ao 


TEMP /R2_ 


- WORD 0404040 


THE DEVICE NUMBER, IF “GREATER” THAN +4 RETURN TO THE CALLING 
-IN4 © LINES 1» 2 AND 20 ). NOW WE PERFORM A LEFT SHIFT ON — 
GIANT 64 BIT WORD >. THIS IS DONE IN FOUR STEPS OF SIXTEEN BITS 
os aioe CARRY ‘REGISTER - ‘C1 BIT oe : 
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TEMP= TEMPS (- “1)&CTEMP+ca+c3+02+01)_ 


ard THE INITIAL VALUE ‘OF ‘TEMP. IS STORED IN. REGISTER 2 AND THE CARRY 
_EBISTER CLEARED € LINES 3 AND 4 ). NOW THE SHIFTS ARE EXECUTED AND THE 
IBBLTANT CARRYS ADDED TO REGISTER 2 ( LINES 5 - 16 )» WE WRAP IT UP” 
INES 17 AND 18 )» MOVE THE LOW. ORDER BITS” TO REGISTER 2 ¢ LINE 19 ), 
‘ND RETURN TO WHERE WE CAME FROM ( LINE 20 De SPACE FOR TEMP. Is CREATED — 
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2 MIO 1020 
Be L102: 13510000 
5 A6 
6 A0s0917sL102 
DR : 402031000esL101 
AOU. eee en ee sone aeeeeanc- foe eeess-- spices 
*x ** * 
: eae, 3 ae sae ake 
* * * * u * ‘ 
be Oe * * * * * 
QU os tem aha on Rh a Ran han eke so KK 
* * * * * * x 
* * * * BS * * 
* , oR ok * o* * Ox 
* kk 2K 2k kK 
A6V Se ecee tien Kee H- Keene eee kee 
T= 0 T = 16 FIELDS 
me) 1 
DELTA T= 1 FIELD 
DELTA V= 1+25V 
FREQUENCY= APPROX 4 HZ 
AMPLITUDE= 20V PP ‘ 
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Shan 


USED» a LOOP 


AND LOOP L102: 


‘ 


WHICH USES THE 


8 RE EATING TRIANGLE 


FASO IOI IK RAIA RR 


woe eee ee -  -  - -- - e 
Bec Beare a 


lll eerie ed 


‘SINE WAVE 


177300 +200 


500 +100 


oS 


1) 


Dp) 


®) 


Sa ee ee ee ee ee ee 


“NEXT THE TABLE IS CODED AS FOLLOWS: 


058s 
1030 
46 


132100 


46 


135200 


A6 


13,400 
46 
1321000 
A6 
1342000 
46 
13»4000 


46 


135100000 


A6 


4050s14sL101 


{ 


13540000 


46 
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a piee, 
cu Ana 
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CHAPTER 5 - SUMMARY 
¥EAEERECLEEREPESESS 


51. LIMITATIONS OF PRESENT. SOFTWARE 
BALA PEREIAH A TEACHES EYEE HEHE GEREN 


AS OBVIOUS THE PROGRAM FAILS TO SATISFY THE ORIGINAL DESIGN 
CRITERIA» THE PROGRAM IS NOT INTERACTIVE. IT IS NOT CONCERNED WITH 
GRAPHIC DESIGN OR COMPOSITION. IT CANNOT REPROGRAM ITSELF IN RESPONSE 
OT EXTERNAL STIMULAE- HOWEVER IT'S NOT A TOTAL LOSS. THE BASIC 
G ROUNDWORK IS COMPLETE. THE ELEMENTS OF THE LANGUAGE OUTLINED IN 
FAENDICES A AND B ARE STILL BEYOND THE UNINITIATED. BUTs FROM THESE 
ELEMENTS A HIGHER LEVEL LANGUAGE WILL BE CREATED. THIS NEW LANGUAGE WILL 
AGILITATE THE DIALOGUE BETWEEN THE ARTIST AND THE PROGRAM ALLOWING HIM 
OTCREATE THE IMAGES AND SEQUENCES OF IMAGES iN A LANGUAGE HE UNDER=— 
TANDS3 A GRAPHIC DESIGN LANGUAGE. 

- THE PRESENT PROGRAM RUNS IN BATCH MODE. THAT IS» THE DATA MUST 
B PREPARED BEFORE THE PROGRAM IS RUN. THEN THE MAIN PROGRAM AND THE 
ATA ARE LINKEDs LOADED AND FINALLY PROCESSED. IF THE RESULTS ARE NOT 
UITE AS EXPECTED € THE NORM RATHER THAN THE EXCEPTION ) THEN THE WHOLE 
ROCESS MUST BE REPEATED$ HARDLY INSTANT GRATIFICATION. 
AGAIN, THIS MODE OF OPERATION IS ONLY TEMPORARY$ REAL-TIME 
MIERACTION WILL BE ADDED BY EXPANDING THE INTERPRETER ROUTINE: TO 
MLUDE THE ABILITY TO LISTEN AND TALK BACK. 
_IF THE PROGRAM LISTENS AND TALKS. THEN IT CAN LEARN. COMBINING 
HE RANDOM NUMBER GENERATOR WITH A SIMPLE ALGORITHM FOR ANALYZING 
MGES WE CAN ENDOW THE PROGRAM WITH A PERSONALITY ¢- OR SEVERAL PERSON- 
IATIES >. ‘: 
BUT -WHAT IS THE LANGUAGE SPOKEN BY THE ARTIST AND THE PROGRAM? : 
_-HAT'S A QUESTION FOR Were TMUENG RESEARCH « : 
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DIT BRANCH Be a Ss ba aie 
HIGHE R EVEL LANGUA BASED ‘oN THE ELEMENTS AND” 


